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1 Introduction 

A commonly recurring approximation to real rate processes is of the form: 

N ^-mN 

where m is some positive rate constant and Nit) measures the current value of 
some property relevant to the process — radioactive decay is our typical student 
example. The simplest stochastic version addresses the situation where N{t) is 
the size of the current population and the rate constant depends on the distri- 
bution of properties in the population — so different sections decay at different 
rates. Then the interest lies in the evolution of the distribution of properties 
and of the related statistical features like entropy, mean and variance, for given 
initial distribution. We show that there is a simple closed solution for an exam- 
ple of an epidemic in which the latency and infectivity are distributed properties 
controlled by a bivariate gamma distribution. 

We consider a class of simple stochastic rate processes where a population 
N is classified by a smooth family of probability density functions {Pt,t > 0} 
with random variable a > 0, having mean Et{a) and variance cr^(i). Karev [1] 
formulated this situation in the form 

N{t) = j^lt{a)da andP,(a) = ^ (1) 

it{a) = ~alt{a) so lt{a) ^ lo{a)e-"'' (2) 

from which he obtained a large range of general solutions. We summarise as 
follows 



N{t) = N{0)Lo{t) where Lo(t)= / Po{a)e-''Ua 

Jo 



(3) 



N = -Et{a)N where £;t(a) = / alt{a) da ^ _ ^^°g-^o (4) 



dt 

Et{a) = -a\t) = {Et{a)f ~ Et{a^) (5) 

P,{a) = e-^'^ and Z,(a) = e-'^'LoW (6) 

Pt{a) = Pt{a){Et{a)-a). (7) 
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Figure 1: Part of the family of McKay bivariate gamma probability density 
functions f{x, y) with correlation coefficient p = 0.6 and ai — 5. 



The elegance of Karev's approach hes in the fact that £o(^) is the Laplace trans- 
form of the initial probability density function Po{a) and so conversely Po{a) 
is the inverse Laplace transform of the population (monotonic) decay solution 
■ He gave the particular solutions for the cases of initial distributions that 
were Poisson, gamma or uniform. 



2 Entropy dynamics 

It is easy to deduce the rate process for entropy from Karev's model. The 
Shannon entropy at time t is 

St = -Et (log Pt{a)) ^ -Et {log ^^j^l^) (8) 

which reduces to 

St = S^ + \ogL^{t) + Et{a)t. (9) 
By using ijt(a) = — CT^(t), the decay rate is then 

This result shows how the variance controls the entropy change during quite 
general inhomogeneous population processes. In fact equation [lO] and further 
related results were given also in a subsequent paper Karev [5]. We note that 
the reverse process of population growth may have applications in constrained 
disordering type situations [3]. 
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Figure 2: Correlation coefficient p from equation (15) for McKay probablity 
density functions, in terms of a\^ai. This represents correlation between latency 
and infectivity periods. 



3 Epidemic model 



This example adds to the work of Britton and Lindenstrand |2| in which they 
use independent univariate gamma distributions for the periods of latency and 
infectivity in an epidemic model that they illustrated with data from the SARS 
outbreak [6]. Our contribution is to use a bivariate gamma distribution which 
allows possible correlation between the random variables representing the pe- 
riods of latency x and infectivity y. We obtain a closed analytic solution and 
show that the same qualitative features persist in the presence of correlation. 

The family of McKay bivariate gamma density functions M, is defined on < 
X < y < oo with parameters ai,CTi2,a2 > and probability density functions, 
Figure [T] 



f{x,y;ai,ai2,a2) 



( — ) 

V CT12 ' 



(°l+°2) 



^Q2-l, 



r(ai)r(a;2) 



(11) 



Here ai2 is the covariance of x and y and f{x, y) is the probability density for the 
two random variables x and y — x + z where x and z both have gamma density 
functions. Thus z is the period during which infection occurs and it controls the 
rate process as we see in the sequel. We obtain the means, standard deviations 
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Exponential growth rate of infectivity r 




Figure 3: Plot of the Malthusian parameter r against the coefficients of variation 
of latency and infectivity Ty with means fx^ — 3, iiy — 2 and Rq — 2.2 from 
the SARS data. So the exponential growth rate of infectivity decreases with 
variability in latency (tx) but increases with variability in infectivity (tx). 



and coefficients of variation by direct integration: 

(ai + a2)\/oi2 



Mean : 

SD : 

CV: 



/ai2, CTy 
1 



ai 



OL2(T\2 



1 



%Ja\ + a2 ' 



(12) 

(13) 
(14) 



The correlation coefficient, and marginal probability density functions, of x 
and y are given by 



P 



0L\ 



/i(^) 



h{v) 



> 

«! + a2 

(^)Ta;"i-ip/ 



r(ai) 



a; > 



(— ) 



r(ai + 012) 



y>0 



(15) 
(16) 
(17) 



Figure [2] shows a plot of the correlation coefficient from equation (151. The 
marginal probability density functions of latency x and infectivity y are gamma 
with shape parameters a\ and ai + a2, respectively. It is not possible to choose 
parameters such that both marginal functions are exponential, so the two ran- 
dom variables cannot both arise from Poisson processes. 
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Exponential growth rate of infectivity ?; 




Figure 4: Plot of the Malthusian parameter r against the means of latency fj,x 
and infectivity iiy with coefficients of variation = Ty = 4/7 and Rq = 2.2 
from the SARS data. So the exponential growth rate of infectivity decreases 
with mean latency (fix) and with mean infectivity (fix). 
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Figure 5: Contour plot of the infectivity rate A against the coefficients of vari- 
ation of latency Tx and infectivity Ty with mean latency fix = S and r = 0.053 
from the SARS data. The levels are A = 1.1 dotted, A = 1.5 dashed, A = 3 thin 
and A = 10 thick. 
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Figure 6: Contour plot of the infectivity rate A against the McKay parameters 
a\ and a2 with mean latency ^i^ — 3 and r = 0.053 from the SARS data. The 
levels are A — 1.02 dotted, A = 1.04 dashed, A — 1.06 thin and A = 1.1 thick. 



We follow the method of Britton and Lindenstrand [2^ §3.2, to compute the 
initial exponential growth rate of the epidemic from their equation (3.4) which 
we write for bivariate x,y in the form 



g-r(y-x) ^ dydx = l (18) 



Jy 




Here, from [2 , Rq = Xfi^. for the average number of infections per infective, so 
A is the contact rate; this gives the Malthusian parameter as 



(19) 



Thus, r is monotonically decreasing with /i^., fj,y and r^. but increasing with r^; 
this is illustrated in Figure [3] and Figure |4] using typical values from the SARS 
epidemic [5] . Figure [s] and Figure [6] show contour plots of the infectivity rate A 
using typical values from the SARS epidemic [6] . 

We turn next to the evolution of the distribution oi z = y — x, the interval of 
actual infection as the population N(t) of uninfected individuals declines with 
time t. From §1 above, this corresponds to the case when Po{z) is a gamma 
distribution and by the result of Karev [4 

pJz) - ^^e-^-t - (-s + t)^ z''-^ ^-z(s+t) (20) 
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Figure 7: Approximate information distances cIEm = V^m (equation (24)) in 
the McKay manifold, measured from distributions Tq with exponential marginal 
distribution for x so ai ~ I and = 1. So the surface represents distances 
from a Poisson process for latency. 



Then the mean, standard deviation and coefficient of variation are given by 

,.{t) = -A^ (2f) 

o.it) - ^ (22) 
r.(t) = 4- (23) 



sfk' 



4 Information geometry 

fnformation geometry of the smooth family M of McKay bivariate gamma prob- 
ability density functions has been studied in detail in Arwini and Dodson [1 . 
This provides a Riemannian metric on M, so yielding a curved 3-manifold, and 
moreover the metric is subordinate to maximum likelihood/maximum entropy 
processes. Here we illustrate how the geometry may be used to provide a nat- 
ural distance structure on the space of McKay distributions. First we measure 
distances from distributions with exponential marginal distributions — those for 
which latency is controlled by a Poisson event process with ai = 1, Tj; = 1. The 
derivation of a distance from distribution Tq is given in [T| , and yields in terms 
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Figure 8: Approximate information distances dEm = \fEM (equation (25)) in 
the McKay manifold, measured from distributions Tq with exponential marginal 
distribution for y, so ai + a2 = 1 and Ty — I. So the surface represents distances 
from a Poisson process for infectivity. 



of Tx and p 



Em{Tx, p)\[To:ai=l] 



1 - 



+ 3 log (r^) 



1 1 

r2 p2 



- 1 



- 1 



+ 7 



(24) 



where = is the digamma function and 7 is the Euler gamma 

constant — of numerical value about 0.577. Figure [7] shows a plot of dEM = 
■<y Em{tx, p) From equation ( 24 1 . This is an approximation to the Rieman- 



nian distance but it represents the main features of the information distance 
of arbitrary latency distributions Ti from the curve of distributions Tq with 

"1 = 1, Ta; = 1. 

Repeating the above procedure for the case when Tq has (ai+a2) = 1, which 
corresponds to an exponential infectivity distribution (and a Poisson process of 
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infections) we obtain 

EM{ai,a2)\[To:ai+a2 = l] = IV" ("2) " V' (1 " "l) I 

1 

+ 4 

This is plotted in Figure [8] 

Geodesic curves in Riemannian manifolds give minimal arc length and exam- 
ples are given in [3] for manifolds of WeibuU, gamma and bigamma distributions, 
together with gradient flow curves for entropy. More details of the information 
geometry of uniform, exponential, gamma, Gaussian, and bivariate versions with 
applications are provided in the book pj. 
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